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Abstract. We analyze random walk in the upper half of a three dimensional lat- 
tice which goes down whenever it encounters a new vertex, a.k.a. excited random 
walk. We show that it is recurrent with an expected number of returns of \/log t. 



1. Introduction 

The model we will analyze in this paper (see section [2] for a precise definition) 
is a variation on excited random walk. Excited random walk is a walk on a d- 
dimensional lattice (d = 1 seems to be the richest case) which has a drift in some 
fixed direction whenever it encounters a new vertex. See | BW03l lV031lKllZ05IIZ06l 
for recent results, | PW97 D99 1 for a Brownian motion analog, and | AR05 1 for some 
simulation results. Excited random walk is proving to be far more tractable than 
other self interacting processes such as the reinforced random walk or the "true" 
self-avoiding walk. 

In this paper we shall perform excited random walk on a half space. Thus the 
walk's natural drift downward is counterbalanced by the stiff floor. In a sense, 
the walk exhibits a self critical behavior: if the walk "tries to escape" and visits a 
large number of new vertices, it is pushed down to the floor and becomes almost 
2 dimensional and thus recurrent. If on the other hand the walk returns too many 
times to the same vertices, it will upon returning typically behave like simple ran- 
dom walk in 3 dimensions, which is transient. 

Thus, if a two dimensional random walk has approximately log t returns to the 
origin until time t, and a three dimensional random walk has approximately 1 such 
return, we should expect excited random walk to take some intermediate value. 
A somewhat less vague, but still heuristic argument, says that the value should be 
y/log t: the projection of the walk on the (x, y) plane is a two dimensional random 
walk so it returns to every column about log t times. If it reaches x vertices in the 
column, it would accumulate a downward drift of x. Assuming homogeneous- 
ness, it would visit the floor about \ogt/x times and accumulate this amount of 
upward drift. Since these should balance we get x — logt/x or x = y/log t. 

We shall prove that the \/\ogt heuristic is in fact accurate, and get in particular 
that the walk is recurrent, a fact which is not at all clear a-priori. The actual proof 
only follows the heuristic half way. The proof of the upper bound (see section [3} 
will use different methods. The proof of the lower bound will mimic the heuristic 
argument, but will use the already established upper bound. An important tool in 
proving the lower bound will be a coupling argument between two instances of 
excited random walk (section|D, which enables us to strengthen the upper bound 
and replace the role of homogeneousness in the heuristic. Unfortunately, we were 
forced to assume a deterministic downward drift to make ends meet. 
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As a side remark, the square root heuristic also works for the analogous model 
in two dimensions, and one gets that the average number of visits of excited ran- 
dom walk to the floor is of the order of \ft. The two dimensional case is less 
interesting because recurrence can be proved easily by coupling to simple random 
walk (so that the simple random walk is always higher than the excited random 
walk) and this argument does not require deterministic drift or specific floor be- 
havior. We will not present any details of the two dimensional case. 

1.1. Open Problems. As already remarked, we were not able to prove the case 
where the walk, upon hitting a new vertex, goes down with some probability p < 
1. The upper bound (theorem^ carries through unchanged, but the coupling 
argument (lemma [8) requires that the configuration be downward closed which 
is not true for a probabilistic drift meaning that our techniques only give a lower 
bound for the average number of visits to the floor, but one cannot deduce from 
that a lower bound for the number of visits to a specific vertex, or even recurrence. 

1.2. Acknowledgments. We would like to thank Alain-Sol Sznitman for a useful 
discussion concerning the heuristic argument above. This research was carried 
out while GK was staying at the Weizmann Institute of Science as a Charles Clore 
postdoctoral fellow, and he would like to thank the institute for its generous sup- 
port. The writing process was partially supported by the National Science Foun- 
dation under agreement DMS-0111298. Any opinions, findings and conclusions 
or recommendations expressed in this material are those of the authors and do not 
necessarily reflect the views of the National Science Foundation. 

2. Preliminaries 

Definition. In this paper, excited random walk (ERW) is a process of points {R(t) 
= (x(t), y(t), ^(t))}^! in H := {(x, y, z) e Z 3 : z > 0} such that R(0) = = (0, 0, 0) 
and R(t + 1) is created as follows: 

• Floor — when the walk is currently on a floor vertex, i.e. z(t) = it moves 
with probability | up and with probability | to either of the 4 sides. 

• Visited — when the walk is on a non-floor vertex it visited before, namely 
R(t) = R(u) for some u < t, then it moves like a simple random walk. 

• New — when the walk is at a non-floor vertex it never visited, then it 
moves downwards deterministically, namely R(t+1) = (x(t), yif), z(t)— 1). 

We can also talk about an "ERW starting from v" for some v e H and in this case 
we take R{0) = v instead. 

A more-or-less equivalent process is the symmetric ERW, defined on Z 3 with 
the "excited steps", i.e. the steps performed when reaching a new vertex (x, y, z) 
go down if z > and up if z < 0. Also, a vertex (x, y, z) is considered visited if 
R(u) = (x,y,z) or if R(u) = (x,y,—z) for some u < t. At the middle level the 
walk has probability | for the sides and ^ for the up or down. Thus if R(t) is a 
symmetric ERW then (x(t), yif), \z(t)\) is an ERW, and vice versa, an ERW can be 
symmetrized by adding random coin flips that will decide, whenever the walk is 
at z = whether to go up or down. 

Given an ERW R at some time t, we denote by Vis.zj(t) the set of visited (non- 
floor) vertices i.e. {R(u) : u < t} \ {(x, y, 0)}. When t is clear from the context, we 
shall omit it, referring to the set of visited vertices as Visij. 



EXCITED RANDOM WALK AGAINST A WALL 



3 



It is important to notice that conditioning on the past (i.e. on R[Q, t] for some t) 
is identical to conditioning on Vis(t) and R(t). This can be given a formal mean- 
ing using the notion of conditional probability (see e.g. |D96 4.1c]) but instead we 
shall use the following definition. For any set of vertices V C H we shall define 
an ERW "starting from (v, V)" by defining R(0) = v and V1s_r(0) := V and con- 
tinuing in the natural way. Clearly R[t, oo) is the same as an ERW starting from 
(R(t), Visii(i)). Some of our results (mainly theorem^ hold also for an ERW start- 
ing from V for a general V. In others (like theorem this generalization requires 
assuming that V is a legal configuration, i.e. a configuration which can be Visfl(i) 
with positive probability. It is easy to see that this is equivalent to V being finite, 
connected and downward-closed. 

The hitting time of a random walk R (simple or excited) of a subset A c Z 3 is 
the first time t > such that R(t) € A. Notice that due to the requirement t > 
the hitting time is non-trivial even if A contains the starting point R(0). 

For a subset Adl? we denote by OA the internal boundary of A i.e. all vertices 
in A with a neighbor outside A. B(v, r) will denote a ball around v with radius r. 

When we write logn we always mean max{l,logn} and logO := 1. We use C 
and c to denote various universal positive constants, which could take different 
values, even inside the same formula. C will be used for constants which are 
"large enough" and c for constants which are "small enough". 

3. Upper Bound on the number of visits to a point 

In this section we shall prove the following: 

Theorem 1. Let R be an ERW starting from some point w G H and some configuration 
V. Let v <E EL Let V(t) = V(t; v) be the number of times R returns to v until time t. 
Then 

EV(t) < Cy/\ogi. 

We shall use the theorem for V empty or the visited set of some past ERW. It 
should be noted, however, that the theorem holds when starting from any con- 
figuration, even one which is impossible to achieve using ERW, for example an 
isolated visited vertex. 

The proof requires dividing into subshells and doing careful analysis of the 
transitions of ERW from one shell to the next. This is somewhat technical, so we 
shall first (section [3.1> sketch a "single shell" (well, a ball) argument which gives a 
weaker result with some simplifying assumptions. We hope this makes the proof 
clearer. Next (section [3.2t we shall give some simple lemmas that allow to compare 
two one-dimensional processes. After that (section l3.3> we shall analyze ERW in a 
single shell, and finally (section l3.4> we shall wrap the whole thing up. 

We shall prove the claim for a symmetric ERW, and lose only a factor of two in 
the constant C. Obviously, we may assume t is large enough. It will be convenient 
to assume V(t; w) also counts time 0. 

3.1. Simplified sketch. The argument we will now sketch only gives that the 
number of returns to a vertex v is < C log 5 ^ 6 1. To see this, examine symmetric 

1 /3 

ERW and take a ball around v with radius log ' t and examine "visits to the ball" 
by which we mean the time between one hitting of the ball and the next escaping 
from a ball of double radius. Inside the ball there are only log t vertices therefore, if 
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we think about visits to the ball that pass through more than log 1 / 6 t new vertices 
as "bad", then there can be no more than log 5 / 6 1 bad visits. On the other hand, a 
"good" visit is limited by the amount it differs from a simple random walk: even 
if we allow an opponent with total view of past and future to distort a simple ran- 
dom walk at less than log 1 / 6 1 times, she cannot force the walk to pass through v 
unless the original, simple random walk, passes through a ball of radius log 1 / 6 1 
around v, the probability for which (at every visit to the outer ball) is < C log -1 / 6 t. 
Since, from two dimensional arguments, there are only log t such visits, then the 
total number of good visits to v is also bounded by C log 5 / 6 t. Summing the good 
and the bad proves the claim. 

3.2. One dimensional processes. 

Lemma 1. Let Rbe a nearest-neighbor stochastic process on {1, ... ,n} with a uniform 
bound 

P(R{t) = R(t) + 1 1 R[0, t]) < q m VR(t) e {2, . . . , n - 1} 

for some numbers {q2, . . . , q n -i}- Let S be a nearest-neighbor Markov chain on {1, . . . , n} 
starting from R(0) with the transition probabilities (again from itoi + 1) equal to qi. Let 
s and r be the probabilities that S and R respectively hit n before hitting 1. Then 

r < s. 

Proof. This follows directly from the fact that we can couple the two processes in 
a way such that S is always to the right of R and their difference is always even. 
See e.g. |L02|for some background on the coupling method. □ 

Lemma 2. Assume qt < q < |, i = 2, . . . ,n — 1 are the transition probabilities of a 
nearest-neighbor Markov chain Ron {1, ... ,n} and let rj be the probability that R hits n 
before hitting lifR starts at j. Then 

Tj+x > r 3 {l + c) 

where the constant c > may depend on q but not on n. 

Proof. Let S be a nearest-neighbor Markov chain on {1, . . . , j + 1} starting from j 
with transition probabilities q. Then the probability that 5 reaches 1 before j + 1 
can be calculated explicitly |D96 example 5.3.5] and is > (1 — 2q)/(l — q) which 
we may denote by c. Hence (using lemma we get that the probability p of R 
starting from j to reach 1 before j + 1 satisfies p > c. However, 

r j = (! - P) r j+i 

and we are done. □ 

Lemma 3. Assume < p < qi < q < \ are the transition probabilities of a nearest- 
neighbor Markov chain Ron {1, ... ,n} starting from j and let rj be the probability that 
R hits n before hitting 1. Then 



where C may depend on p and on q but not on n or on the qi-s. 



EXCITED RANDOM WALK AGAINST A WALL 



5 



Proof. In the case qi = p for all i, the numbers rj satisfy a simple quadratic recur- 
sion, namely r\/+2 — ^fj+i + ~^r T j = ®> which can be solved explicitly to show that 
r j < C(p/ (1 — p))" - - 7 . Hence it is enough to measure the effect of a change in one 
qi namely to show that if q\ = qi except for one I, and q\ > Qi then 

r$<rj(l + C(gt -?/)). (1) 
Let A and B be some parameters. The numbers 

s ..= h ■> ' 

3 ' [Arj + B j>I 

are "harmonic" except possibly at / — 1 and I (meaning that Sj = q'jSj+i + (1 — 
q'j)sj-i) hence for the values of A and B satisfying that sj = n and sj = ^sj+i + 
(1 — q'j)si-i we would get that Sj is harmonic and as a consequence, r'j = sj/s n . 
These conditions give that for the required s/+i, 



\si+i - r I+ i\ < ri 



1 1 

q'i qi 



ri-i 



1 1 



1-9/ i-qi 

and by lemma|2this gives |s/+i — r/+i| < Crj(q'j — qj). Hence (^4 and B are linear 
in sj and we get that 

A=l + 0(q' 1 -q I ) ^ B = 0(q' I -q I ) ^ 

ri+i - Ti r I+ i - ri 

(the constant implicit in the notation O here may also depend on p and q). Another 
appeal to lemma |2] allows to replace the rj / (ri+i — rj) factors with a constant and 
we get that s„ = 1 + 0(q'j — qi). Hence we get Q and the lemma. □ 

3.3. Behavior in shells. The proof of theorem^in the next section uses lemma[3| 
for one-dimensional processes created by examining the hitting times of shells of 
radius 4™. A three dimensional Brownian motion (which is our model, in some 
vague sense) starting from a point on a shell of radius r has probability g to reach 
\r before 4r, independently of the starting point. For an ERW this probability 
depends on the starting point and on Vis, but we will compare the probability that 
a good visit, in the same sense as in the proof sketch above, reaches \r before 4r 
to |. This will be done in lemma [5] The other lemmas handle boundary cases: 
lemmas H| and |6] are for the outermost shell and lemma|7|is for the innermost shell. 

Lemma 4. Let r > 1 and let K r := B((x,y),r) x Z namely an infinite vertical cylinder 
around v = (x, y, z). Define stopping times i" 1 / 011 * as follows: ig ut := 1, and for i > 1, 

t\ n := min{t > t™\ : R(t) G K r } (2) 

i° ut := min{i > if : R{t) £ K 2r }. 

Define I := max{i : t™ < t}, "the number of visits to K" . Then 

P(i > A log*) < Ce- cX VAX). 

Proof. For every i > 1 we know that t™^ is in the exterior boundary of Ki r which 
we denote by S. Hence for i > 1 

P(4 n > C'i + *) > min¥ w (R hits dK t+2r before K r ) 
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which is a purely two-dimensional question. Denoting by a the two-dimensional 
discrete harmonic potential we can continue the inequality (see |K87| for a nice ex- 
position of the connection between harmonic functions and the harmonic potential 
in particular and hitting probabilities) 

^ min{a(u;) : w € 5*} — max{a(u>) : w £ dK r } 
~ max{o(w) : w £ dK t +2r} — xniix{a(w) : w £ dK r } 

and since a(w) = A log \w\ + B + o(l) |575| P12.3] 

= log2 + o(l) > c 
log((t + 2r)/r) +o(l) ~ log* 

which gives the lemma immediately. □ 

Lemma 5. Let r > 4, let v £ 1? and let w £ dB(v,r). Let R be a (symmetric) 
ERW starting from w and some configuration V c Z 3 , and let T be its hitting time of 
dB(v,Ar) U dB(v, |r). Let e > r -1 / 2 be some parameter. Let G be the event that R 
encounters less than er new sites until T. Then 

P({R{T) £ dB(v, ±r)} n G) < ± + Ce 1 ^ 4 . (3) 

Proof. Couple R to a simple random walk W in the following manner: if R is in 
a visited (non-floor) vertex let R and W perform the same step. Otherwise they 
walk independently according to their respective rules. The lemma will be mostly 
proved once we estimate \R(t) — W(t)\. There are two sources for the discrepancy: 
new vertices and floor vertices. Therefore let us write \R(t) — W(t)\ — \N(t) + F(t)\ 
where 

N(t)= R(u + 1)- R(u)-W(u+1) + W(u) 

u<t 

R(u) is a new vertex 

and F is the same for floor vertices. Now, G obviously implies |iV(i)| < 2er for 
all t < T so we need only estimate F. Now, for every time t when R is in a 
floor vertex, the expected motion of R is zero (remember that we are talking about 
the symmetric ERW). In other words, if we denote by U the i'th hitting of the 
floor then F(U) is a symmetric random walk on Z 3 with bounded steps. By the 
reflection principle (see e.g. |K85 chapter 2, lemma 1]) maxi<„ |.F(fi)| has the same 
tail behavior as |F(i ra )| i.e. a square-exponential one. Denoting by / the number of 
times R hits the floor by time T we get 

P({max \F{t)\ > XVN} n {/ < N}) < Ce~ cX2 VA > 0, V7V e N. (4) 

Examine one time t when R(t) is at the floor. It is easy to see that a simple random 
walk starting from a floor point has probability > c/r to exit the ball B(v, 4r) before 
returning to the floor. Therefore we have 

P(R hits dB(v, 4r) or some new vertex before returning to the floor) > — . 

r 

This implies that if / > (2/ci)er 2 then with probability > 1 — Ce~ cer there are 
at least er + 1 times U < T when the event above happened. This, however, 
contradicts the event G so we get 

P({/>(2/ Cl )er 2 }nG)<C7e-« r . (5) 
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Combining Q) and 10 we get 

P({max \F(t)\ > CXryfe) n G) < Ce"^ + Ge~ cer VA > 0. 

We pick A := ^e -1 / 4 and get (using also the requirement e > r -1 / 2 ) 
P({max|F(t)| > re 1/4 } n G) < Ce. 

This is the estimate of F that we need. 

Now, in general we have for any s > 1 that R(T) € dB(v, \r) implies that 
either for some t < T we have \N(t) + F(t)\ > s or that W hits <9B(v, |r + s) 
before hitting dB(v, 4r + s). The probability for that to happen (denote it by q) we 
calculate using the discrete Green function of 1? (denote it by a) the same way we 

used the harmonic potential in the previous lemma. Since a(z) = j|y + O (rip) ID 

Theorem 4.3.1] we get q = I + 0(s/r). Applying this with s = r(2e + e 1//4 ) we get 

P({i?(T) e dB(v, \r)} n G) < 

< P(VKhits dB(v, \r + s)) + P({max |iV(f) + F(t)\ > s} n G) < 

< - + 0(s/r) + Ce < - + Ge 1/4 . □ 
5 5 

Lemma 6. Let r > 4, let v — (x, y, z) and let w e dB(v, r). Let Rbe a (symmetric) 
ERW starting from w and some configuration V C Z 3 , and let T be its hitting time on 
dB(v, 4r) U dB(v, \r). Denote 

Q := (dB(v, 4r) n B((x, y),2r) x Z) U dB(v, \r) 

i.e. Q is the union of a) the outer sphere intersected with a concentric vertical cylinder of 
half its radius and b) the inner sphere. Let G be the event that R encounters less than er 
new sites until T for some e sufficiently small. Then 

F{{R{T) e Q} n G) < l - c 

The proof is very similar to the proof of the previous lemma — in fact, simpler 
— the only additional fact needed is that a simple random walk has probability 
< 1 — c to hit Q. This is quite easy to see and we omit any further details about the 
proof of lemma [6] 

Lemma 7. Let r > 1, let v e 1? and let w € dB(v,r). Let R be a (symmetric) 
ERW starting from w and some configuration V c Z 3 , and let T be its hitting time of 
dB(v, 4r) U {v}. Let G be the event that R encounters no new sites until T. Then 

P({R(T) = v}nG)< C/r. (6) 

Similarly if R starts from v then this probability is < 1 — c. 

Proof. This time we couple R to a random walk W which has the same behavior 
as R at the floor, i.e. when W hits the floor it has probability | to go to each of 
its floor neighbors, and probability ^ for each of its vertical neighbors, but other 
than that is simple. Clearly if G happened then R(t) = W(t) for all t so it is enough 
to estimate the corresponding probabilities for W. 

However W is a reversible random walk (meaning that it can be realized as 
a walk on a weighted graph) so Varopoulos |V85| and Hebisch and Saloff-Coste 
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|HSC93, theorem 2.1] apply. Together they give that the probability pt(x, y) that 
W starting from x and going t steps will be at y satisfies 

C 



Pt(x,y) < ^e-^ 2 ^ Vx,y,t. 



Summing over t gives that the discrete Green function a(x, y) = ^2 t Pt(x, y) satis- 
fies a(x, y) < C/\x — y\ and a(x, x) < C. a is harmonic so the same calculations as 
in lemma|51give the estimates for the probabilities. □ 

3.4. Proof of theoremQJ Let /3j = 4~ J \/IogT defined for j = 1, . . . , J until the first 
J such that (3 j < \/Togt, and let 0j+i = Pj+2 = 1- Let Si := dB(v,(3i), and in 
particular = 5,7+2 = {v}- The spheres 5,; are the analogue of the sphere at 
log 1 / 3 1 discussed in the "simplified sketch" section. Let t t denote stopping times 
at these spheres defined, somewhat similarly to J3, by 

J+i 

t\ = minu : R(u) 6 Sj 

i=l 



ti + \ = minu > ti 



u e Sj-i U S j+ i when R(U) € Sj, 2 < j < J + 1 
u e S 2 when R(U) e Si 



(notice the asymmetry at v — the only case where R(t. L ) and R(ti+i) may belong 
to the same Sj). Let 8 e (0, 1) be some parameter sufficiently small to be fixed 
later. In fact, it is enough to take S := min{(2/15C7i em ma|5i) 4 J e iemma|3 |}/ but the only 
meaning of this expression is in the various conditions that will appear below. Let 
Gi (G standing for "good") be the event that R hits less than 5j~ 8 f3j+i new sites 
between time ti and time < s +i where j < J + 1 is given by R(ti) € Sj. Obviously, 
there is nothing stopping <5j _8 /3j + i to be smaller than 1 (indeed it must be if j > J). 
Remembering the "simplified sketch" section, the event d is the analogue of the 
event "good visit to v" with respect to the relevant sphere Si. 

To estimate V(t) we examine the walk performed before the time when v was 
hit, and ask: when has G\ (the complement of Gi) occurred last? More precisely, 
define the event H® to be Gi n G,+i n . . . n Gk-i where k > i is the first such that 
R(tk) e Si U {v} and let H, be the event that H° happened and R(t k ) = v. In 
particular, if R(ti) = v then Hi happens while if R(U) S Si it does not. Define 

(1) Ej (2 < j < J + 1) to be the number of is satisfying that R(U) G Sj, that 
Gi did not happen, and that did happen. 

(2) Ej +2 to be the number of is such that R(ti) = v and d n H i+ \ happened. 

(3) Ei to be the number of is such that R(U) e Si and H i+ i happened. 

For all these we count only is that the relevant tk, i.e. the time where R(tk) = v, 
happened before time t. Clearly, V (t) — J2j=i Ej therefore it is enough to estimate 
these EjS. Now if t is sufficiently large then we can apply lemma[5]for all j < J 
(the problem is only in the condition "e > r -1 / 2 " of lemma [5] where here e = \Sj~ 8 
and r — j3j). For j = J, J + 1 we use lemma|7|and in total we get 

+ CS^j- 2 1 < j < J 
t'(G; n (/?(/, ; - S' y+ l !' I /?[!)./;]. /?(/;) - S,) ■ {Clog-^t j = J (7) 

-c j = J + 1. 
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Here and below we use the notation P(X|Y, E) for a variable Y and an event E 
to mean the function P(X|Y) restricted to E — here everything is discrete so this 
simply means that the inequality holds for any value of R[Q, ti] for which R(ti) £ 
Sj. Denote the values on the right hand side by qj. This allows us to estimate 
¥(Hi \R[Q, ti]) by comparing the process R(U) to a Markov chain Qj on {1, . . . , J + 
1} starting from j with the transition probabilities qj (we use here lemmaQ}. If 5 is 
sufficiently small (explicitly if 8 < (2/15Ci e mma|5]) 4 ) we would have qj < -| for all 
j < J. Hence we can use lemma|3]on the interval [1, J] and we get 

J a 

¥(Qj hits J before 1) < C4 j - J JJ(1 + Cj- 2 ) < C4 j - J = C^f. 

The step from J to J + 1 contributes another C/Sy 1 factor so we end up with 

F(Hi | R[0,U]) < — when R(t t ) e Sj,j < J (8) 
P{Gi n H i+ i I R[0, ti])<l-c when R(U) = v. (9) 

We note that B{v,(3j-\) \ B(v,(3 J+ i) contains < C0^_ Y points. Therefore the 
number of is such that G\ can occur together with R(U) S Sj is no more than 



cp 3 



'i-i 



< Cf4T 2: > log* when j < J (10) 



< C^/logi when j = J, J + 1. 

(here and below we will be "folding" the S into the constants c, C). Using J5} for 
i + 1 (and j + 1, which would also estimate the case that £ shows that 

Ej is dominated by a sum of independent Bernoulli trials with probability CP~^ lr 
so 

¥(Ej > Cj s 4- j Vlogl + Aj 4 2~ J log 1/4 1) < Ce- cA 2<j<J (11) 
while for j = J, J + 1 we have deterministically 



Ej < CVlogi- (12) 

In particular, E Yfjtl Ej < C v / \ogi. 

Next we estimate E\ . We start with an estimate of the number of is such that 
R{U) € S 2 - Denote it by F. Define Q = (Si n ^2/3 2 ) U S 3 where if is an infinite 
cylinder as in lemma |3| By lemma |6] if only S is sufficiently small (S < ei e mma|6j!/ 

P(Gi n {R(t i+1 ) e Q} | R[0, k], R(ti) eS 2 )<l-c 

Hence the number X\ of times this event happened satisfies 

P(Xi > (1 - c)F + X^FlogF) < Ce' c>? . (13) 

To prove dl3i compare to an infinite sequence of Bernoulli trials e, with probability 
1 — c for which a rough estimate (by summing over s) shows that ¥(3s < t : 

Ei=i ei > (1 - c)a + Av^gi) < Ce~ cX \ 

Next, the number of times G\ happened is bounded using fTol by C log t so we 
get that the number X 2 of is for which i?(f,) e 5*2 and R(t i+ i) ^ Q satisfies 



l (X 2 < cF - C log i - A v/FfogF) < C*e- cA . (14) 
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However, every such event is an "entry into Kp 2 " in the sense of lemma|I]so 

P(X 2 > Alogt) < Ce- cX . (15) 

We get 

P(F > Alogt) < P(X 2 > VAlogt) +P({F > Alogt} n {F > V\X 2 }) < 

<* Ce- cv/I + P({,F > Alogt} n {F > V\X 2 }). (16) 

For A sufficiently large we have that F > A log f and F > VaX 2 imply that in fact 
F > CX 2 + C log t + C VAF log F and so by 

P({F > Alogt} n {F > %/AX 2 }) < C7e- cVX . (17) 

But \Y7\ can be made to hold not just for A sufficiently large by increasing the C on 
the right hand side and with M6\ we get 

¥(F > Alogt) < C7e- cVI VA>0. (18) 

This is the estimate of F that we need. 

On the other hand, let i satisfy the requirements for E\, namely R(U) G Si and 
H i+ i has occurred. Using J8} we get 

F(H i+1 \R[0,ti}, R{U) G 5i)=EP(fr <+ i|iJ[0 1 * i+ i] 1 flfa) G Si) < 

E 

< E(C/f3 2 ) = C/fo 

where E here is the conditional expectation over the variable R[0, tj. As in J13i 
above, we get 

F(Ei > CF/f3 2 + \^{F/(3 2 )\ogF) < Ce~ cX . (19) 
Combining il8l and fT9l gives 

P(#! > Av^gl) < P({Ei > \/A(F//3 2 )} n {Fx > A^logt}) + 

+ P(F//3 2 > V Alogt) < C7e- cAl/4 . (20) 

Hence EFi < CyTogt and this part is estimated as well. 

The estimate of Ej +2 comes from again by comparing to a sum of indepen- 
dent Bernoulli trials we get 

P(F/+2 > (1 - c)V(t) + Av/F(t)logV(t)) < Ce- cA2 
or, equivalently, 

P(E J+2 > C(V(t) - E J+2 ) + Xy/V(t)logV(t)) < Ce- cX \ 
Adding 03), G3 and GO) gives 

J+i 

P(V(t) - E J+2 > Av/Ioil) = P(J2 E 1 ^ X V^gt) < Ce~ cXl/4 

3 = 1 

SO 

P(F J+2 > Xyfiogt) < P({F, /+2 > V\(V{t) - E J+2 )} n {E J+2 > X^ogt}) + 

+ P(V(t) - E J+2 > v / Aloii) < Ce" cAl/8 (21) 
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which shows that Ei?,; + 2 < C\/log t and since this is the last term in V(t), the 
theorem is proved. □ 

Corollary 1. For every u£B we have 

E(V(t; v) | V(t; v) ^0) < C^Jlogi (22) 
where V (t; v) is the number of visits to v after t steps. 

Proof. This is because conditioning on V(t; v) ^ is identical to considering an 
unconditioned ERW starting from (v,V) where V := Vis(T), T being the hitting 
time of v and walking for a distance of t — T. Applying theorem ^ shows that 
EV(f — T; v) < C\/\ogt for any V and integrating over T and V shows □ 

Corollary 2 (exponential decay of V). There exist constants c, C s.t. for any point 

v and any A > 0, F(V(t; v) > X^logt) < Ce" cA . 

Proof. Using theorem^and Markov's inequality we get some constant K such that 
for every configuration V one has that an ERW starting from (v, V) has probability 
< \ to visit v more than Ky/log t visits in the next t steps. Define L := [K Vl°g ij + 
1 and let be the fcL'th return to (here |_ - J stands for the integer value). As 
in the previous corollary, the ERW after is the same as an ERW starting from 
(v, Vis(Tfc)) so we get 

P(r fc+ i > Tk+t\R[0,n]) > 5. 
Hence we get that P(rfe < t) < 2~ k , which was to be proved. □ 

3.5. Postfix remarks. The values chosen for the /3j are in some sense "non-opti- 
mal". A more natural choice would be (3j = e~ 23 \J\og t, i.e. a doubly exponential 
decreasing sequence. For example, if one decides to use only a finite number of (3-s 
(finite in the sense that the length J is independent of t) and looks for the optimal 
(3-s, the optimality requirement gives a set of equations which, when solved, give 
a doubly exponential decreasing sequence with /3i = log 1 / 2-6 1 and (3j = log 1 / 6 t. 
Actually, the fact that we stopped our series 0j when reaching ^/Yogt is an atavism 
from this optimization. Either choice for the [3j would give the same conclusion in 
the theorem. 

Lemmas |S] [6] and |7| could have been simplified significantly if the behavior of 
the ERW at the floor would have been | for its floor neighbors and | for its upper 
neighbor. Unfortunately, the coupling argument used in the next section requires 
the probability of the upper neighbor to be < |. 

Since corollary[5]gives a very simple argument for the exponential decay of V, 
one might wonder why did we bother with all the intermediate estimates of the 
form P(something > Xyfiogl) < Cexp (_ c A somefraction ), namely or goj? 

They seem to be necessary for the calculation of Ej+2, ED - We would like to see 
a proof that can estimate EEj + 2 using only S/=i E-Ej, but we were not able to 
overcome some dependency issues. 

Conjecture. The correct tail decay is square-exponential, namely F(V(t) > \y/\ogt) < 

One possible interpretation of the word "correct" above is: for every A and 
every t > t {X),F(V(t) > A^/IogT) > c e - cx ' '. 
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4. The coupling argument 

As we will show below, when the starting configurations are downward closed, 
it is possible to couple two instances of ERW such that one is always above the 
other. Here it is more convenient to think about them as walks in a half space 
rather than as the symmetrized version we used in the previous chapter, so from 
now on we will use the half space version of ERW. The following lemma uses this 
argument to show a certain monotonicity in the hitting probabilities. It will be 
crucial towards the end. 

Lemma 8. Let R, S be two ERWs, starting from a w e H, and from visited configurations 
satisfying Vis^(O) c Viss(O) which are both downward-closed. Let v £ H be a floor 
vertex and let V R (t) and Vs(t) be the number of visits of R and respectively S to v in the 
first t steps. Then for any t e N and k e N we have ¥(V R (t) > k) > P(V s (t) > k), and 
in particular E(V R (t)) > E(V s (t)). 

Proof. We define a coupling between R and S so that for any instance of the cou- 
pling the number of times R hits v before time t is greater or equal to the number 
of times S hits v before time t. The coupling requires a time change so, if we denote 
by r the number of coupling steps, we need two time change functions t R (r) and 
ts(r) to get back the time for each process. For brevity, we will replace R(t R (r)) 
with just R(t) or just with R (ditto for S). 

To define the coupling recall the three types of vertices an ERW can be at: floor, 
visited and new. We define the coupling according to the types of the vertices both 
walks are at, generally trying to make them walk "together": 

• If both R and S are at the same type of vertex — they move together 
(i.e. make the same step). 

• If one of them is at a new vertex, and the other is not — the one at the new 
vertex makes a move downwards, while the other one waits. 

• If one of them is at a visited vertex, and the other at a floor vertex, we let 
the first one move. If the move it made was downwards — the second 
walk waits. Otherwise, the second walk moves in the same direction. 

We denote by Waiter) (Waits (r)) the number of times R (S) waited until time 
r of the coupling. Thus t R (r) = t — Waiter) that is until step r of the coupling 
the walk R makes r - Wait r (t) real steps. 

As above, when looking at a specific step r of the coupled walk, we omit the 
step index from the various values thus writing x R and Wait# instead of x r (t) 
and Waitij(r). 

The lemma will now follow from the following claim: 

Claim. At each step of the coupling we have: 

(1) x R = x s and y R = y s . 

(2) z R - Wait_R = zs - Waitg. 

(3) z R < zs. 

(4) If S is not at a new vertex, then Viss is downward closed and \is R c Viss- 

Proof. First notice that both walks make the same moves on the (x, y)-plane, re- 
gardless of the vertex type they are at, so at each step x R = xs and y R = ys, 
giving (1). 

(2) follows from the fact that at each step of the coupling the walks either move 
together, or one of them waits while the other moves down. 
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To prove items (3) and (4) we use induction on the step of the coupling. Assume 
that the claim holds up some step, and look at the next step of the coupling. 

We will first prove item (3) continues to hold. If both walks make the same 
move, (3) continues to hold. Otherwise, we are in one of the following two situa- 
tions: 

(1) One of the walks is on a floor point, and the other one is above it. 

(2) One of the walks is at a new vertex and the other is at a visited one. 

In the first case, either the walks move together, or the walker at the floor waits, 
while the second one goes down a step. But since this means before the step R was 
strictly below S, we get that after the downward move still zr < z$- In the second 
case, if R is the one at the new vertex, or if zs > zr then after the next step still 
zr < zs, so the only case we must worry about is that both walks are currently at 
the same vertex q, and q is a new vertex for S, while R has already visited it. To 
rule out this case, look at the first time R visited q. At that time, by the induction 
hypothesis, (items (1) and (3)), S was directly above R, and by the coupling rules, 
R would drop at least one step, and S would drop until it reached a vertex it has 
visited before (or the floor), prior to R making any sideways or upward move 
(and therefore prior to R returning to q and thus strictly before our current time). 
Thus when S reaches a non-new vertex, by the induction hypothesis (item (4)), 
q G Visfl C Viss contrary to our assumption. Thus this last case is dismissed and 
we have proven (3). 

To see (4), roll back to the last induction step a when S is not in a new vertex. 
By the induction hypothesis, Viss(cr) is downward closed and VisR(a) C Viss(cr). 
Seeing that Viss remains downward closed is obvious. To see Vis r C Viss divide 
into cases according to which one moves. The only interesting case is when they 
make a simultaneous move in the x,y plane. However, if R(a + 1) Viss(cr) 
then so is S(a + 1) (because Vis is downwards closed) and then S must drop until 
closing Vis(S') before t, so Viss contains the entire column [Q,zs(cr + 1)] above 
xs, Us which contains any points added to Vis(i?) between a + 1 and r. □ 

To finish the proof of lemma [S] just take an instance of the coupling, and run it 
until R makes t moves. Since at each step of the coupling xr — xs, ur — ys and 
z r < z s w e get that each time S hit a specific floor point, R hits it as well. The 
fact that Zr — Wait = 25 — Waits implies that in the remaining steps S has to 
complete t moves, he can at most reach the same z coordinate as R (if he goes 
straight down), so he cannot bypass the number of times R hits v. □ 

We now use the coupling lemma for the following useful corollary. 

Corollary 3. For any floor point v and any t e N, E(V(t;v) | V(t;v) ^ 0) < 
EV(t;0). 

Proof. Divide the probability space of all possible i-histories according to the path 
the walk takes until reaching v for the first time (Or not reaching it at all). Examine 
one path which does reach v in t steps, and let T v denote the first time it hits v. 
Then, according to the coupling lemma, regardless of the history until time T v 
(Vis(T l ,)), the expected number of times the walk will hit v in the next t steps is less 
or equal to the expected number of times a walk starting at v with no history (thus 
with no visited vertices) will visit v in t steps. But clearly there is no difference 
between the (expected) number of times a walk starting at v will hit v and the 
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number of times a walk starting at hits 0, so E(V(t; v) | T v , Vis(T„)) < E(number 
of returns to v in the next t steps after T v \ Vis(T v )) < E(V(t; 0)). Since this holds 
for any value of T v and Vis(T„), the corollary follows. □ 



5. Lower bound and proof of recurrence 

In the first few steps we will use the upper bound on the number of visits to 
a point to get a lower bound on the number of new vertices the walk visits, and 
consequently a lower bound on the number of times the walk hits the floor. Here 
we still do not need the coupling argument. 

Lemma 9. Denote by Nit) the number of different vertices the walk visits till time t, then 
3c> such that E(N(t)) > ct/^/Togi. 

Proof. Fix t and then 

E(N(t)) = E(#v : V(v) ^ 0) = ^P(V» ^ 0) = 

V 

by the definition of conditional expectation, 



by corollary^ 



V E(V(v)) 

4- E(V(v)\V(v) ? 0) " 



^ VloK t JXos t ^ 



We denote by DF{t) the number of different floor points the walk visits till time 
t. The next lemma bounds E(DF(t)). 

Lemma 10. E(DF(t)) < Ct/logt 

Proof. Since any two distinct floor points have different (x, y) coordinates, the 
number of different floor points visited by the ERW (till time t), is bounded from 
above by the number of different points its (x, y) projection visits. But the projec- 
tion of the ERW on the (x, y) plane is a simple random walk of length < t. There- 
fore E(DF(t)) is bounded above by the expected number of different vertices a 
SRW visits in t steps, which by Dvoretzky-Erdos | DE51 1 is < Ctj log t. □ 



Corollary 4. There exists a c> such that E(| Vis(*)|) > ct/^/Togl. 

Proof. Because | Vis(t)| = N(t) - DF(t). □ 

Now we are ready to bound from below the expected number of times the ERW 
hits the floor. 

Lemma 11. Denote by F(t) the number of times the ERW hits the floor (z = 0) until time 
t. Then there is a positive constant c > 0, independent oft such that E(F(t)) > ct/^/logt. 
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Proof. Look at the expected change of the z coordinate when the walk makes a 
single step. The walk has one of three behaviors according to the type of vertex it 
is currently in. If the walk is in a visited vertex — it acts as a SRW, so the expected 
change to the z coordinate is 0. If the walk is in a new vertex — it goes down a 
step — so the expected change to the z coordinate is —1, and finally, if the walk is 
on the floor then the expected change in the z coordinate is \. We get, by linearity 
of expectation, 

E(z{t)) = -1 • E(| Vis(t)|) + \ ■ E(F(t)). 

5 

Since the walk always stays on the upper half space z > 0, we have E(z(t)) > so 
E(F(t)) > 5E(| Vis(t)|) > 5c</VIogIby the previous corollary. □ 

With the above estimates, all we need to do is combine our bounds on E(F(t)) 
and E(DF(t)) with corollary|3]to get: 



Theorem 2. There exists a constant c > such that E(V(t; 0)) > c^/logt. 
Proof. From linearity of expectation, 

E(F(t))= ]T nv(v))= £ (E(F(u) | V(v) ^ 0) • P(V(u) ^ 0). 

floor v£ floor 

By corollary^ E(V(v) | V(v) ^ 0) < EV(0) for any floor point v, so 

E(F(t)) < E (^(2)) ' HV(v) > 0) = E(V(0)) • F ( v ( v ) > 0) = 

floor u£ floor 

= E(V(0)) ■ E(DF(t)) 
so by lemmaslTUlandlTTl 

, , . . E(F(t)) ct/JYSgi r 

For some absolute constant c > 0. □ 
Theorem 3. ERW is recurrent. 

Proof. Assume to the contrary that there is a positive probability that an ERW R 
visits the origin exactly k times, k finite. Let r be the hitting time when R reaches 
the origin for the fc-th time. Examining Vis b(t) we see that there is a finite set 
X and a positive probability po > such that if the walk R is currently at and 
Visfl, = X then P(R will not return to 0) > pq. By the coupling lemma (lemma|8j, 
if the walk R is at 0, and X C Vis(i?), then P(i? will not return again to 0) > po- 
Since the set of visited vertices of a walk only increases, we conclude that once 
X C Vis r, the number of times the walk returns to is dominated by a geometric 
random variable with parameter 1 — po- 

Next, notice that for any finite set of vertices Y, there is a positive probability 
pi (Y) such that a walk currently at will visit all the vertices in Y before returning 
to with probability > p\, regardless of the walk's history. (One such possible path 
is simply reaching each vertex v = (x, y,z) € Y by walking on the floor [avoiding 
(0, 0)] till you reach (x, y, 0), then climbing slowly up until reaching the desired 
vertex, and finish the path by dropping on the (0, 0, *) column from high enough.) 
Thus the number of returns of ERW to before all vertices of X are visited is 
dominated by a geometric random variable with parameter 1 — p\(X). 
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Combining the above we get that the total number of returns of ERW to is 
dominated by the sum of two geometric variables (with parameters 1 — po, 1 — 
Pi), and thus has finite expectation. But this contradicts theorem|2 (The expected 
number of returns till time t behaves like y/k>g t), so ERW is recurrent. □ 
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